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© Method and apparatus for correcting timing errors for a multi-picture display. 
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© A picture-in-a-picture television receiver displays 
a compound image which includes a compressed 
image derived from an auxiliary signal inset in a full- 
size image derived from a main signal. The auxiliary 
composite video signal is sampled (124,126) syn- 
chronous with a system clock signal that is burst 
locked to the main signal. The sampled data signal 
is separated (128) into luminance and color informa- 
tion component signals, which are subsampled (130) 
and stored in a field memory (136) synchronous with 
the system dock signal. The clock signal phase 
used for horizontal subsampling is determined at the 
start of each line to compensate for skew errors in 
the auxiliary signal. The luminance samples retrieved 
from the memory are applied to clock transfer cir- 
cuitry (146) which resynchronizes the samples to a 
phase shifted version of the system clock signal to 
compensate for skew errors in the main signal. The 
phase shifted (142) clock signal is synchronized to 
the horizontal scanning signals used to display the 
compound image. The color information component 
signals (150) are not resynchronized to the phase 
shifted clock signal. The component signals of the 
compressed image are combined (154) to form a 



composite signal having color information that is 
synchronized to the main signal. The compressed 
signal is substituted (114) for a portion of the main 
signal to generate a signal representing the com- 
pound image. 
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METHOD AND APPARATUS FOR CORRECTING TIMING ERRORS AS FOR A MULTI-PICTURE DISPLAY 



This invention relates to apparatus and a meth- 
od for reducing the visibility of timing errors in for 
example, the inset image of a picture-in-a-picture 
(pix-in-pix) television display system. 

In a pix-in-pix system, two images from possi- 
bly unrelated sources are displayed simultaneously 
as one image. The compound image includes a full 
size main image with an inset compressed auxiliary 
image. The subjective quality of the inset image 
may be affected by timing errors in either the main 
signal or the auxiliary signal. 

Timing errors relevant to the present invention 
may occur, for example, when either the main or 
auxiliary signal is a nonstandard signal. As used 
herein, the term nonstandard signal means a video 
signal having a horizontal line period which may 
vary in length relative to the horizontal line period 
set by the signal standard to which the video signal 
nominally conforms (e.g. NTSC, PAL or SECAM). A 
noisy but otherwise standard signal may appear to 
be a nonstandard signal if the noise is of sufficient 
amplitude to mask transitions of the horizontal line 
synchronization (horizontal sync) signal. 

To understand how these timing errors may 
affect the inset image, it is helpful to know how the 
auxiliary signal is processed and displayed. In a 
conventional pix-in-pix display system, the auxiliary 
signal is sampled at instants determined by a sam- 
pling clock signal which, desirably, bears a fixed 
relationship to the horizontal line scanning frequen- 
cy of the auxiliary signal. To aid demodulation of 
the chrominance signal components of color televi- 
sion signals, the sampling clock signal desirably 
has a frequency that is a multiple of the chromin- 
ance subcarrier frequency. If the multiple is an 
even number, e.g., 4, for standard signals, this is a 
suitable sampling signal since, under ail major vid- 
eo signal standards, it produces an integer number 
of samples per line interval. Under the NTSC sys- 
tem, this sampling clock signal may be developed, 
for example, by a phase locked loop which pro- 
duces a sampling signal having a frequency of 4fc, 
four times the frequency, fc, of the color subcarrier 
signal, and which is locked in phase to color refer- 
ence burst component of the auxiliary composite 
video signal. 

The auxiliary video signal is separated into its 
component parts, generally a luminance signal and 
two color difference signals. These component sig- 
nals are then subsampled both horizontally and 
vertically to develop signals that represent a com- 
pressed image. The lines of samples taken during 
one field of the auxiliary signal are stored in a 
memory. These samples are read from the mem- 
ory for display using a clock signal that is desirably 



related to the horizontal line scanning frequency of 
the main video signal. 

When the auxiliary signal originates from a 
noisy source or from a nonstandard source such as 

s a video tape recorder (VTR) or a video game, the 
frequency of the horizontal sync signal may appear 
to vary significantly from line to line while the 
frequency of the color subcarrier signal, and thus 
of the color reference burst signal, may seem rela- 

70 tively stable. This variation can be caused by pic- 
kup head misalignment or by stretched tape in a 
VTR or by inaccuracies in the frequencies used by 
video game circuitry. Since, in the example set 
forth above, the sampling clock signal is locked in 

75 phase to the color reference burst signal, cor- 
responding samples on successive lines may be 
shifted or skewed relative to each other. When 
these lines of samples are displayed in synchro- 
nism with the main signal, the pixels produced by 

20 these corresponding samples may not line up verti- 
cally. Consequently, any vertical lines in the inset 
image may appear jagged (if the period of the 
horizontal sync signal changes randomly) or tilted 
(if there is a fixed error in the relative frequencies 

25 of the horizontal sync and color burst signals). The 
frequency and phase variations which cause this 
type of image distortion are known as timing errors 
or, alternatively, as skew errors. 

One type of timing error, which is relevant to 

30 the present invention, results from frequency or 
phase variations between the main horizontal sync 
signal and a video display clock signal that is 
phase locked to the color reference burst compo- 
nent of the main signal. Errors of this type may 

35 randomly change the distance between the left 
side edge of the main image (defined by the hori- 
zontal sync pulses) and the beginning of lines of 
the inset image (defined by the display clock sig- 
- nal). Main signal timing errors of integral numbers 

AO of sampling clock periods may be compensated for 
in the phase locked loop circuitry which generates 
the horizontal sync signal. Skew errors which are a 
fraction of a sampling clock period may be more 
difficult to correct. 

45 One method of correcting these types of timing 

errors is to use interpolation to develop sample 
values that are matched to the clock signal used to 
store or display them. Another method is to shift 
the phase of the clock signal used to display the 

so sample values so that it is properly aligned to the 
horizontal sync signal. These methods are de- 
scribed in U.S. Patent No. 4,638,360 entitled 
"Timing Correction for a Picture-ln-Picture Televi- 
sion System". 

Skew errors may also be corrected by generat- 
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ing samples that represent component video sig- 
nals in synchronism with a skew shifted line locked 
clock signal. These samples are then applied to 
clock transfer circuitry which aligns the samples 
with a line-locked clock signal that is not skew 
shifted. U.S. Patent No. 4,782,391 entitled "Multiple 
Input Digital Video Features Processor for TV Sig- 
nals," relates to a system of this type. 

The first two methods described above use two 
substantially independent clock signals. Aside from 
the extra circuitry used to generate an additional 
clock signal, systems which use multiple clock 
signals may need to be carefully shielded to pre- 
vent radio-frequency interference between the sig- 
nals. 

In the third method described above, the lu- 
minance and color difference signal components of 
the auxiliary signal are separated by analog cir- 
cuitry and then digitized. A system using this meth- 
od may be more complex than a system which 
digitizes the composite video signal and then sepa- 
rates it into its component parts. In addition this 
second method uses line-locked clock signals, so it 
may be difficult to encode the color information 
signals of the compressed video signal so that the 
.two signals may be time-division multiplexed for 
display. 

The present invention is embodied in a system 
which compensates for timing errors in a first video 
signal relative to a second stored video signal. This 
system includes a first clock signal for retrieving 
samples of the second stored video signal from 
memory. A signal phase alignment circuit shifts the 
phase of the first clock signal to generate a second 
clock signal that is synchronized to the horizontal 
scanning signal derived from the first video signal. 
A clock transfer circuit, responsive to the second 
clock signal, aligns retrieved samples synchronous 
with the first clock signal, to a predetermined 
phase relationship with the phase shifted clock 
signal. 

Brief Description of the Drawings 

FIGURE 1 is a block diagram of a television 
receiver which includes an embodiment of the 
present invention. 

FIGURE 1a is a block diagram of exemplary 
circuitry for generating a subsampling clock sig- 
nal used in the television receiver shown in 
FIGURE 1. 

FIGURE 2 is a block diagram of a clock phase 
shifter suitable for use in the television receiver 
shown in FIGURE 1. 

FIGURE 3 is a block diagram of circuitry which 
illustrates the operation of the signal phase 



alignment circuitry shown in FIGURE 2. 
FIGURE 4 is a block diagram of clock transfer 
circuitry suitable for use in the television re- 
ceiver shown in FIGURE 1 . 
5 FIGURE 5 is a timing diagram which is useful 
for describing the operation of the clock phase 
shifter circuitry shown in FIGURE 2. 
The present invention is described in the con- 
text of digital circuitry which implements, for exam- 
10 pie, a pix-in-pix feature for a consumer television 
receiver. It is contemplated, however, that this in- 
vention has broader application. It may be used in 
other systems where two images or portions of two 
images are displayed concurrently (e.g., side by 
15 side or one over the other) and it may employ 
analog circuitry, such as charge-coupled devices, 
in place of the digital memory circuitry. 

In the television system described below, a 
main video signal is processed by conventional 
20 analog circuitry to produce a full-size image. An 
auxiliary signal is received, digitized and processed 
by digital circuitry to produce a luminance signal 
and two quadrature phase related color difference 
signals. These separated signals are subsampled 
25 to develop signals representing a compressed im- 
age. The subsampled signals are stored in a mem- 
ory which holds one field interval of the com- 
pressed signal. When the compressed image is to 
be displayed, the stored signals are retrieved from 
30 the memory and encoded into a composite video 
signal. This composite video signal is substituted 
for a portion of the main composite video signal to 
generate a compound signal which is processed by 
the analog circuitry to display a compound image. 
35 This compound image includes a full-size main 
image with a compressed auxiliary image dis- 
played as an inset 

A composite video signal includes three com- 
ponent signals, a luminance signal, Y, and two 
40 color difference signals, for example, (R-Y) and (B- 
Y). The two color difference signals modulate re- 
spective quadrature phase related color subcarrier 
signals to produce a chrominance signal which is 
additively combined with the baseband luminance 
45 signal to generate the composite video signal. Con- 
ventional analog techniques for decoding a com- 
posite video signal include low-pass filtering to 
recover the luminance signal, Y, and band-pass 
filtering to recover the chrominance band signals, 
so The chrominance band signals are then synchro- 
nously demodulated using a regenerated color sub- 
carrier signal. 

In general, when digital processing techniques . 
are used, a composite video signal is first sampled 
55 and digitized. The sampling clock signal used to 
develop these samples is typically locked in phase 
to the color burst signal of the composite video 
signal. This sampling signal may aid in the de- 
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modulation of the chrominance signal. For exam- 
ple, if the selected sampling clock signal has a 
frequency of 4fc, four times the frequency, fc, of 
the color subcarrier signal, successive samples of 
the separated chrominance signal may be repre- 
sented by the sequence (R-Y) ( (B-Y), -(R-Y), -(B-Y), 
(R-Y), etc. where the minus signs indicate sampling 
phase and not necessarily sample polarity. The (R- 
Y) and (B-Y) color difference signals may be recov- 
ered from this sequence by a process of demul- 
tiplexing and selective polarity inversion. 

Thus, if these conventional techniques are 
used to decode the chrominance signal compo- 
nents of two independent composite video signals, 
it is desirable to generate two oscillatory signals 
related to the respective color subcarrier signals of 
the two composite video signals. Using two clock 
signals may complicate the design of the receiver, 
since electromagnetic shielding may be needed, to 
limit interference between the two signals. 

An alternative method for demodulating two 
video signals is to generate only one oscillatory 
signal, for example, the main signal color subcar- 
rier signal. This signal is then used to generate a 
sampling clock signal for digital circuitry which 
processes the auxiliary signal. However, since the 
chrominance signal phases of the main and auxil- 
iary signals may be different, it may be desirable to 
include circuitry which corrects the phase of the 
digitized decoded color difference samples based 
on the color reference burst component of the 
auxiliary signal. 

The choice of a sampling clock signal is also a 
factor in determining what type of skew-error com- 
pensation circuitry is to be used in the system. 
Since a clock signal that is locked to the main 
burst signal may be less closely aligned to the 
auxiliary horizontal sync signal than a clock signal 
that is locked to the auxiliary burst, the possibility 
of skew errors when the compressed auxiliary sig- 
nal is stored in the memory is increased. Moreover, 
if the sampling clock signal is locked to the main 
signal burst, skew errors caused by noise in the 
main signal or by variations in the relative frer 
quencies of the main signal horizontal sync and 
color subcarrier signals are not reduced. A sam- 
pling clock signal that is locked to the horizontal 
synchronizing component of the auxiliary signal 
may also be used. 

In the television receiver described below, 
skew errors of the first type are reduced to a 
maximum of one-third of one clock period (e.g. to a 
maximum of 23 ns for a sampled data NTSC signal 
having a sampling frequency of 4fc) and skew 
errors of the second type are substantially elimi- 
nated. 

In the system described below, the luminance 
signal component of each horizontal line interval of 



the auxiliary video signal is subsampled in a six to 
one ratio and then displayed at a sample rate that 
is one-half of the 4fc sampling clock signal derived 
from the main signal burst. This results in an effec- 

5 tive sampling ratio of three to one. Thus, the effec- 
tive subsampling clock signal has a frequency that 
is one-third of the frequency of the clock signal 
used to display the samples. When the subsam- 
pling clock signal is generated, signals having six 

70 different evenly spaced phases are provided. Skew 
errors of the first type are reduced by selecting the 
best one of these six possible subsampling clock 
signal phases at the start of each horizontal line of 
the auxiliary video signal. The selected phase is 

15 determined by the relative timing of each phase to 
the auxiliary horizontal sync signal. 

Skew errors of the second type are substan- 
tially eliminated by using phase alignment circuitry 
to generate, from the main clock signal, a display 

20 clock signal that is aligned to signals which control 
the horizontal scanning of the display. A clock 
transfer circuit is then used to translate samples 
that are provided in synchronism with the main 
clock signals into samples that are synchronous 

25 with the display clock signal. Since The display 
clock signal is derived from the main clock signals, 
there is no distortion of the output samples caused 
by frequency differences between the two clock 
signals. 

30 In the drawings, broad arrows represent signal 

paths for conveying multi-bit digital signals. Line 
arrows represent connections for conveying analog 
signals or single-bit digital signals. Depending on 
the processing speed of the devices, compensating 

35 delays may be required in certain of the signal 
paths. One skilled in the art of digital signal pro- 
cessing circuit design will know, where such delays 
are needed in a particular system. 

FIGURE 1 is a block diagram of a television 

40 receiver having a pix-in-pix feature which includes 
an embodiment of the present invention. In FIG- 
URE 1, a main composite video signal, MCV, pro- 
vided by a main tuner 110 is applied to conven- 
tional synchronization signal separation circuitry 

45 112. The. circuitry 112 generates signals MHS and 
MVS representing, respectively, the horizontal line 
and vertical field synchronizing signal components 
of the signal MCV. The circuitry 112 also provides 
a main burst-gate signal, MBG, a signal MU which 

so indicates when the signal MCV is the upper field of 
an image and a main composite blanking signal, 
MCB. The signal MCB is generated by phase 
locked loop circuitry which uses a horizontal fly- 
back signal, FB, generated by deflection circuitry 

55 113, as a reference signal. Consequently, the sig- 
nal MCB is locked to the horizontal line scanning 
signals used to produce the video display. It is 
relatively independent of noise in the signal MCV 
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and tends to track variations in the scanning fre- 
quency related to the loading of the high-voltage 
supply. 

The signal MCV is also applied to one input 
terminal of a multiplexer 114. Another input termi- 
nal of the multiplexer 114 is coupled to receive a 
composite video signal ACV representing a com- 
pressed auxiliary image. The multiplexer 114 is 
controlled by a signal, DM', to substitute the signal 
ACV for the signal MCV in a portion of each field. 
The signal DM is generated by pix-in-pix insertion 
circuitry 120 and clock transfer circuitry 146 as 
described below. The compressed signal, ACV, is 
substituted for the main signal, MCV, when the 
signal DM' is logic-zero. The output signal of the 
multiplexer 114 is a compound composite video 
signal, CCV, representing the main image with an 
inset auxiliary image. 

The pix-in-pix insertion circuitry 120 is respon- 
sive to the main horizontal and vertical synchroniz- 
ing signals, MVS and MHS, and to a clock signal 
MCK to generate the signal DM. The signal DM is 
applied, as set forth below, to the clock transfer 
circuitry 146 to produce the signal DM which is 
aligned to the horizontal scanning signal used to 
produce the compound display. In the present em- 
bodiment of the invention, the compressed auxiliary 
image is displayed during 69 successive line inter- 
vals during each field of the main signal. Each 
displayed compressed line occupies approximately 
one-quarter of the corresponding main signal hori- 
zontal line interval. 

The output terminal of the multiplexer 114 is 
coupled to conventional analog decoder and matrix 
circuitry 116 which, for example, separates the 
luminance and chrominance signal components of 
the signal CCV, demodulates the chrominance sig- 
nal component into quadrature phase related color 
difference signal components and generates, from 
the luminance and color difference signals, red (R), 
green (G) and blue (B) primary color signals for 
application to a cathode-ray tube (CRT) 118. The 
image represented by the signal CCV is repro- 
duced on the CRT 118 under control of deflection 
signals generated by the deflection circuitry 113. 

An auxiliary composite video signal, XCV, from 
which the signal ACV is generated, is provided by 
a conventional television tuner 122. The signal XCV 
is applied to an analog-to-digital converter 124 
which is clocked by the sampling clock signal 
MCK. The signal MCK is generated by phase 
locked loop (PLL) circuitry 140. The circuitry 140, 
which may include a conventional burst-locked PLL 
is responsive to the main chrominance signal com- 
ponent, MC, provided, for example, by the analog 
decoder and matrix circuitry 116, and to the main 
burst-gate signal, MBG, to generate the clock sig- 
nal MCK which has a frequency, 4fc, four times the 



frequency, fc, of the color subcarrier signal compo- 
nent of the signal MCV. The signal MCK is locked 
in phase to the color synchronizing burst signal 
component of the main signal MCV. 
s The color burst signal is a reference signal 

having a predetermined phase relationship with the 
color subcarrier signal component of a composite 
video signal. Thus, the ADC 124 produces samples 
of the auxiliary signal, XCV, that are synchronized 
70 to the chrominance subcarrier signal component of 
the main signal, MCV. 

The samples provided by the ADC 124 are 
applied to auxiliary timing circuitry 126 which, re- 
sponsive to the signal MCK. generates signals 
is AVS, ABG. AU, AS and NL The signal AVS is the 
vertical field synchronizing signal for the auxiliary 
video signal. The signal ABG is the auxiliary burst- 
gate signal. The signal AU indicates when the 
auxiliary, samples are from an upper field or from a 
20 lower field. The signals AS and NL are puise sig- 
nals that indicate which pixels and lines, respec- 
tively, of the auxiliary signal may be used to form 
the compressed image. These signals eliminate 
several lines on the top and bottom of the image 
25 and several pixel positions on the left and . right 
sides of the image. These portions of the image 
are eliminated to reduce the amount of memory 
used to store the image and to reduce the size of 
the inset in which the auxiliary image is displayed. 
30 As set forth above, the subsampling signal AS 

is adjusted in phase at the start of each horizontal 
line period of the auxiliary signal. This phase ad- 
justment effectively selects one of six phase shifted 
subsampling signals generated from the signal 
35 MCK. Using this adjustment, skew errors in the 
display caused by differences in the relative times 
of occurrence of the auxiliary horizontal sync pulse 
and the first stored pixel are limited to 23 ns 
[1/(12fc)] 

40 FIGURE 1a shows exemplary circuitry for gen- 

erating the subsampling signal AS. This circuitry is 
a part of the auxiliary timing circuitry 126. In FIG- 
URE* 1a, the signal MCK is applied to a frequency 
divider 160 which is reset by the auxiliary horizon- 

45 tal sync signal, AHS. The output signal of the 
frequency divider 160, which has a frequency of 
2fc/3, is applied to a seven-bit counter 162 which is 
reset by the signal AHS. The output signal of the 
counter 162 is coupled to first and second decod- 

so ers 164 and 166. The decoders 164 and 166 pro- 
duce logic-one output pulses when the value pro- 
vided by the counter 162 is equal to 19 and 127, 
respectively. The values provided by the decoders 
164 and 166 are used to set respective RS flip- 

55 flops 168 and 170. These flip-flops are reset by the 
signal AHS. The output signal of the flip-flop 168 
and the inverted output signal of the flip-flop 170 
enable an AND gate 174 to pass the signal pro- 
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vided by the frequency divider 160 during the 
central portion of each auxiliary line: Since the 
frequency divider 160 is reset at the start of each 
horizontal line period, the phase of the subsam- 
pfing clock signal AS may vary from line to line to s 
track the phase of the signal AHS. 

The samples generated by the are 124 are 
applied to a luminance-chrominance (Y/C) separa- 
tor and chrominance signal demodulator 1 28, which 
is also coupled to receive the signal ABG provided 10 
by the auxiliary timing circuitry 126. The Y/C sepa- 
rator portion .of the circuitry 128 uses a standard 
low-pass and band-pass filter arrangement to sepa- 
rate luminance signal and chrominance-band sig- 
nals from the auxiliary composite video signal. The 75 
chrominance signal demodulator portion of this cir- 
cuitry separates the chrominance band signal into 
two quadrature phase related color difference sig- 
nals, for example, (R-Y) and (B-Y). 

Since the signal XCV is sampled synchronous 20 
with the color subcarrier signal of the main signal, 
the color difference samples provided by the cir- 
cuitry 128 may need to be shifted in phase to 
correct for phase differences between the color 
subcarrier signals of the main and auxiliary video 25 
signals. To this end, the circuitry 128 is coupled to 
receive the auxiliary burst-gate signal, ABG, pro- 
vided by the timing circuitry 126. Responsive to 
this signal, the circuitry 128 monitors the color 
burst signal component of the sampled data auxil- 30 
iary signal and corrects the phase of the demodu- 
lated color difference signals on a line-by-line ba- 
sis. Exemplary circuitry for performing this function 
is described in U.S. Patent No. 4,558,348. 

The output signal from the Y/C separator and 35 
chrominance demodulator 128 is applied to a sam- 
ple formatter 130. The formatter 130 is responsive 
to the signal AS to horizontally subsample the 
sampled data luminance signal in a six to one ratio 
and to subsample each of the sampled data color 40 
difference signals to produce respective com- 
pressed color difference signals having a sampling 
frequency of fc/9 (4fc/36). This horizontal subsam- 
pling compresses the auxiliary image in a three-to- 
one ratio when the luminance signal is displayed at 45 
a sample rate of 2fc and the color difference sig- 
nals are displayed at an effective sampling rate of 
fc/3. 

Using this subsampling scheme, one pair of 
samples, representing the two color difference sig- so 
nals, is produced for each six luminance samples. 
The formatter 130 reduces each of the luminance 
and color difference samples to six bits of signifi- 
cance and combines the luminance and color dif- 
ference samples such that six bits of each eight-bit 55 
output sample represent luminance information and 
the remaining two bits represent one bit each of 
two corresponding color difference signal samples. 
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This technique spreads each pair of color differ- 
ence samples across six consecutive luminance 
samples. The sample formatter 130 provides these 
eight-bit samples to a buffer 132. 

Samples provided to the buffer 132 are stored 
in a first-in-first-out (FIFO) memory (not shown) 
which is internal to the buffer 132. The stored 
samples are transferred from the buffer 132 to a 
memory 136 under control of memory address 
generation circuitry 134. The circuitry 134 also 
controls the reading of samples from the memory 
136 for display. In writing samples into the memory 
136, the circuitry 134 vertically subsamples the 
horizontally subsampled auxiliary signal to generate 
samples representing a vertically and horizontally 
compressed image. The memory 136 used in this 
embodiment of the invention includes a sufficient 
number of storage cells to hold one field of sam- 
ples of the compressed image. 

Samples are read from the memory 136 at a 
2fc rate responsive to the address signals provided 
by the memory address generator 134. These 
samples are processed by the circuitry described 
below to generate the composite video signal ACV 
which is combined with the signal MCV, as set 
forth above, to generate the compound pix-in-pix 
image. 

The samples read from the memory 136 are 
applied to a sample formatter 138. The formatter 
138 reverses the process performed by the format- 
ter 130, to provide a separate luminance signal and u 
two separate color difference signals, each occur- 
ring at a 4fc sample rate. However, in this embodi- 
ment of the invention, the luminance samples 
change value at a maximum rate of 2fc and the 
color difference samples change at a rate of fc/3. 
The sampled data (R-Y) and (B-Y) color difference 
signals are applied to a chrominance signal en- 
coder 150 which interleaves, interpolates and se- 
lectively inverts the color difference samples to 
generate a sampled data chrominance signal. The 
effective color subcarrier signal of this sampled 
data chrominance signal has the same frequency 
and phase as the color subcarrier of the signal 
MCV since the clock signal, MCK, used by the 
encoder 150 is burst-locked to the main signal. 

The sampled data luminance signal, YA, pro- 
vided by the formatter 138 and the signal DM 
provided by the pix-in-pix insertion circuitry 120 are 
applied to the clock transfer circuitry 146. The 
circuitry 146, described below in reference to FIG- 
URE 4, changes the timing of its input signals to 
generate signals YA' and DM' which are synchro- 
nous with the clock signal YCK. 

The signal YCK is phase aligned to horizontal 
synchronizing signal components of the main com- 
posite signal. Clock phase shifting circuitry 142, 
described below in reference to FIGURES 2 and 3, 
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generates the clock signal YCK by providing mul- 
tiple phases of the signal MCK and the selecting 
one of these phases as the signal YCK. The se- 
lected phase is the one most closely aligned to a 
horizontal line scanning reference signal derived 
from the signal MCB. 

The signal CA t provided by the chrominance 
signal encoder 150, is not aligned to the signal 
YCK. This preserves the alignment of the chromin- 
ance signals of the compressed and main video 
signals. While the lack of alignment may cause 
skew errors in the color signals used in the com- 
pressed image, these errors are not noticeable 
since the human eye is less sensitive to changes in 
color than to changes in luminance and since the 
minimum rise time of a chrominance signal is 
much longer than for a luminance signal. 

The signals YA' and CA are applied to respec- 
tive digital-to-analog converters 148 and 152 which 
generate analog signals corresponding to the re- 
spective sampled data digital signals. These analog 
signals are combined in summing circuitry 154 to 
generate the analog composite video signal ACV 
which is substituted for a portion of the main signal 
MCV to generate the compound composite video 
signal, CCV. 

Instead of multiplexing the signals MCV and 
ACV to develop signals representing the compound 
image, it is contemplated that circuitry may be 
inserted in the analog decoder 116 to multiplex the 
signals YA and C A with respective separated main 
luminance and chrominance signals. Moreover, it is 
contemplated that other component signals such as 
YA and (R-Y)A and (B-Y)A or auxiliary R. G, and B 
primary color signals may be multiplexed with cor- 
responding signals derived from the main video 
signal to generate signals representing the com- 
pound image. 

FIGURE 2 is a block diagram of circuitry suit- 
able for use as the clock phase shifter 142. In 
FIGURE 2, the main clock signal MCK is applied to 
a set of 13 cascade-connected buffer gates 212. In 
this embodiment of the invention, each of the gates 
212 is realized as a pair of logical inverters. Each 
of the buffer gates 212 delays the signal applied to 
its input port by a fixed amount of time. Thus, the 
output signals provided by the inverters 212 repre- 
sent respectively different phases of the signal 
MCK. Ideally, the total delay through all of the 
serially connected buffer gates 212 is substantially 
equal to one period of the signal MCK. However, 
due to process variations in the manufacture of 
integrated circuits containing the clock phase shift- 
er 142, variations in the total delay may vary by as 
much as -50% to + 100%. 

The signals representing 14 different phases of 
the signal MCK, provided by the buffers 212, are 
applied to signal phase alignment circuitry 210. 



The circuitry 210 selects one of these signals as 
being the most closely aligned in phase to the 
horizontal scanning component of the main com- 
posite blanking signal MCB. The signal MCB is 
s applied as a reference signal to the circuitry 210. 

FIGURE 3 is a block diagram of simplified 
phase alignment circuitry which illustrates the op- 
eration of the circuitry 210. This circuitry includes 
only four stages instead of the 14 stages of the 
w circuitry 210. To add additional stages to this signal 
phase alignment circuitry, the elements delimited 
by the broken lines 335 are replicated as many 
times as desired. The circuitry shown in FIGURE 3 
is similar to circuitry described in U.S. Patent 
75 4,824,879 entitled, "Signal Phase Alignment Cir- 
cuitry,". The present circuitry differs from the re- 
ferenced circuitry only in the addition of a pseudo- 
stage 355 which includes AND gates 354 and 358, 
an inverter 356 and an OR gate 357. 
20 The circuitry shown in FIGURE 3 operates as 

follows. Responsive to a positive-going transition of 
the signal MCB, instantaneous samples of each of 
the different phases of the signal MCK are stored 
in respective D-type flip-flops 310. 320, 330 and 
25 340. Since the total delay provided by the buffer 
gates 212 approximates one period of the clock 
signal MCK, the values stored in these, flip-flops 
represent a "snapshot" of all of the phases of the 
signal MCK at the different taps, taken at the transi- 
30 tion of the signal MCB. 

If this "snapshot" includes a positive-going 
transition of the signal MCK (which appears as a 
negative-going transition of the samples from the 
delay line when read from left to right), one of the 
35 flip-flaps, for example, 320 will have a logic-one 
output signal and the next successive flip-flop, 330 
will have a logic-zero output signal. In this instance, 
all of the input signals to an AND gate 334 will be 
logic-one. In this instance, the' output signal of the 
40 ' AND gate 334 will enable the clock phase signal 
provided by a buffer gate 212b to pass through an 
AND gate 338 and an OR gate 360 as the output 
signal of the phase alignment circuitry. 

When the "snapshot" stored in the flip-flops 
45 310, 320, 330 .and 340 includes more than one 
transition, inhibiting circuitry which includes invert- 
ers 316, 336, 346 and 356 as well as OR gates 
337, 347 and 357 allows only the clock signal 
phase corresponding to the first transition to be 
so selected as the signal YCK. When the "snapshot" 
includes only a negative-going transition, or when 
the sample values held in the flip-flops are all logic- 
one, indicating no captured transition, the clock 
signal phase provided by the buffer gate 212c is 
55 selected as the phase aligned output signal YCK. 
This selection is accomplished by the pseudo- 
stage 355. Finally, when the "snapshot" does not 
include any transitions but the values held in the 
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various flip-flops are ail logic-zero, the signal MCK 
is selected as the phase aligned output signal, 
YCK, by the action of AND gates 314 and 318 and 
an inverter 316. 

Referring to FIGURE 2, the signal YCK is ap- 
plied to the clock input terminals of three serially 
connected delay elements 216, 218 and 220. The 
data input signal to the first of these delay stages, 
216, is the signal MCB as delayed by six buffer 
gates 214. The buffer gates 214 delay the signal 
MCB by an amount of time equal to the propaga- 
tion delay through the signal phase alignment cir- 
cuitry 210 plus an amount of time needed for the 
output signal of the circuitry 210 to become stable. 
This stabilizing time may be equal, for example, to 
the maximum signal propagation delay through the 
inhibiting circuitry. The six buffer gates 214 shown 
in FIGURE 2 are exemplary. The exact number 
used depends on the number of stages in the 
alignment circuitry 210 as well as the technology in 
which it is implemented. 

The delay elements 216, 218 and 220 each 
delay the signals applied to their respective input 
ports by one period of the signal YCK. The output 
signal of the delay element 218 and an inverted 
version of the output signal of the delay element 
220 are applied to respective input terminals of an 
AND gate 224. The AND gate 224 provides an 
output signal HREF which is synchronized to the 
signal YCK but is delayed with respect to the signal 
MCB by an amount of time that is fixed to within 
the resolution of the signal phase alignment cir- 
cuitry 210. That is to say, transitions of the signal 
HREF occur with a substantially fixed delay with 
respect to corresponding transitions of the signal 
MCB. The maximum error in this delay is the 
signal propagation delay time through one of the 
buffer gates 212. 

As shown in FIGURE 1, the signals YCK and 
HREF are applied to clock transfer circuitry 146 to 
align the signal DM and the samples of the signal 
YA to the horizontal line scanning signals that are 
used to display the compound signal. FIGURE 4 is 
a block diagram of exemplary clock transfer cir- 
cuitry 146. in overview, the circuitry shown in FIG- 
URE 4 operates as follows. Samples of the signal 
YA are transferred from a register 410 into regis- 
ters 418, 416, 414, and 412 on a rotating basis 
.synchronous with the main clock signal, MCK. 
Sample values are read from the registers 418, 
416, 414 and 412, also on a rotating basis, syn- 
chronous with the signal YCK. These sample val- 
ues constitute the signals DM and YA . 

The following is a more detailed description of 
the circuitry shown in FIGURE 4. The signal MCB 
is applied to an edge detector 425 which includes 
clocked delay elements 424 and 426, an inverter 
428 and an AND gate 430. The output signal of the 



edge detector 425 is a pulse signal, HM, that is 
synchronized with a positive-going transition of the 
signal MCB. The signal HM is applied, to the reset 
input terminal of a modulo-four counter 432. The 

5 clock input terminal of the counter 432 is coupled 
to receive the main clock signal, MCK. The output 
signal of the counter 432 is applied to a decoder 
434. The decoder 434 prbduces a logic-one output 
signal when the value provided by the counter 432 

70 is zero and a logic-zero output signal otherwise. 

The output signal of the decoder 434 is a pulse 
which occurs once every four periods of the signal 
MCK and has a pulse width substantially equal to 
one period of the signal MCK. This signal is ap- 

75 plied to three serially connected delay elements 
436, 438 and 440. Each of these delay elements 
delays the signals applied to its input port by one 
period of its clock signal MCK. The output signals 
of the decoder 434 and the delay elements 436, 

20 438, and 440 are applied to respective load input 
terminals of the registers 418, 416, 414, and 412. 

Responsive to the pulse signal provided by the 
decoder 434, the register 418 is conditioned to 
load a sample value of the combined signals YA 

25 and DM from the register 410. During the next 
period of the signal MCK, the pulse signal propa- 
gates to the output terminal of the delay element 
436. Responsive to this signal, the register 416 is 
conditioned 'to load the next subsequent sample of 

30 the signals YA and DM from the register 410. In the 
same way, the registers 414 and 412 are con- 
ditioned to load the next two respective samples of 
the combined signal YA and DM. 

Sample values are read from the registers 412, 

35 414, 416 and 418 under control of a modulo four 
counter 422. The counter 422 is reset by the signal 
HREF and clocked by the signal YCK. The output 
values provided by the counter 422 are applied to 
a multiplexer 420 to sequentially gate the values 

40 held in the registers 418, 416, 414 and 412 to the 
input port of a register 442. The register 442 is 
responsive to the signal YCK to load a new value. 
The output signal provided by the register 442 is 
the aligned and compressed luminance signal, YA . 

45 Although this signal is provided for each horizontal 
line interval in each field of the main video signal, it 
is only valid during the portion of the 69 line 
intervals in which the compressed image is dis- 
played. 

so FIGURE 5 is a timing diagram which illustrates 

the operation of the clock phase shifter 142 and the 
clock transfer circuitry 146. The signals MCK and 
MCB are applied to the clock phase shifter 142. 
The skew error between the exemplary signals 

55 MCK and MCB is illustrated as the time interval T1 . 
In this embodiment of the invention, the time inter- 
val T1 may have values ranging from 0 ns to 70 ns. 
Responsive to the signals MCK and MCB, the 
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clock phase shifter 142 generates the clock signal 
YCK that is aligned to the signal MCB and thus to 
the horizontal line scanning signals used to display 
the compound image on the CRT 118. The 
negative-going transition 510 of the signal YCK is 
in a substantially fixed time relationship with the 
positive going transition of the signal MCB. The 
time interval between these two transitions may 
vary, from line to line, by the propagation delay 
through one of the buffer gates 212. The transition 
508 of the signal YCK is nominally aligned with the 
positive-going transition of the signal MCB, but, 
due to propagation delays through the gating cir- 
cuitry of the phase alignment circuitry 142 and 
through the inhibiting circuitry of the signal phase 
alignment circuitry 210, the transition 508 may not 
occur in the same time relationship with the signal 
MCB from line to line. 

The buffer gates 214 are included in the phase 
shifter 142 to compensate for this instability in the 
transition 508. These gates prevent the signal MCB 
from propagating to the delay element 216 until the 
clock signal YCK has stabilized. The signal HREF, 
which is generated by the clock phase shifter 142 
from the delayed signal MCB, and the clock signal 
YCK- also have substantially fixed timing relation- 
ships with the signal MCB. The time interval T2 
between the positive going transitions of the sig- 
nals MCB and HREF varies by, at most, the propa- 
gation delay through one of the buffer gates 212. In 
this embodiment of the invention, that propagation 
delay is approximately 5 ns. 

The signals MCK, MCB, YCK, HREF and YA 
are applied to the clock transfer circuitry 146. The 
output signal of the circuitry 146 is the phase 
aligned luminance signal YA and the phase 
aligned control signal for the multiplexer 114 f DM . 
The signal HM is generated internal to the clock 
transfer circuitry 146. This signal begins the stor- 
age of sample values of the signal YA into the 
registers 412, 414, 416 and 418. The signal HREF 
begins the retrieval of sample values from these 
registers. As shown in FIGURE 5, the signal HREF 
is delayed by more than one period of the signal 
MCK relative to the signal HM. This delay ensures 
that the sample values stored in the registers 412, 
414, 416 and 418 are valid when they are read 
under control of the counter 422. in this embodi- 
ment of the invention this one clock period delay 
between the signals HREF and HM is provided by 
- the delay element 436 of the clock transfer circuitry 
shown in FIGURE 4. 

Since the signals HREF and YCK are aligned 
with the horizontal scanning signals used to pro- 
duce the compound display, vertical lines in the 
inset image, including the image borders, are dis- 
played with significantly less skew error than if the 
signals HM and MCK were used. The skew errors 



related to the sampling of the auxiliary signal syn- 
chronous with the signal MCK are apparent only on 
vertical or near-vertical lines in the image. These 
errors are generally less noticeable than skew er- 
s rors in the border of the compressed image which 
are caused, primarily, by instantaneous phase dif- 
ferences between the system clock signal and the 
horizontal scanning signals. 

While the invention has been described in 
70 terms of an exemplary embodiment it is con- 
templated that it may be practiced as outlined 
above with modifications within the spirit and scope 
of the appended claims. For example if the inven- 
tion is practiced in the environment of a video 
75 cassette recorder (VCR), blanking signals are nomi- 
nally unavailable. In this instance signals derived 
from the vertical and horizontal synchronizing sig- 
nals MHS and MVS will be utilized instead of the 
signal MCB. It is also contemplated that auxiliary 
20 input signal may be in component form obviating 
the circuitry 128. Further, a system may be ar- 
ranged to combine main and auxiliary baseband 
luminance and chrominance components at mul- 
tiplexer 114 in which case the main clock signal 
25 may be derived from a source other than the main 
video color reference burst, signal, i.e., from the 
color reference signal of the auxiliary signal or the 
auxiliary horizontal synchronizing signal, etc. In a 
system for displaying two images side-by-side, the 
30 subsampling and interpolation elements of the ex- 
emplary system may be eliminated, and/or the 
sample formatting elements may be eliminated with 
the component signals stored in separate portions 
of the memory. 
35 It should also be appreciated that in an ar- 

rangement where the auxiliary image is not com- 
pressed for display, but possibly only cropped, as 
for a side-by-side display, the auxiliary signal may 
be sampled and stored in memory in composite 
40 form. After the signal is retrieved from memory it 
may thereafter be separated into component form 
for realignment of the luminance component and 
synchronization of the auxiliary chrominance sub- 
carrier with the main video chrominance subcarrier. 

45 

Claims 

1. In a video signal processing system including a 
50 source of main video signal having a horizontal line 
synchronizing signal component and including 
memory means for holding sampled data repre- 
senting a second video signal, apparatus for pro- 
cessing the sampled data in synchronism with said 
55 main video signal characterized by: 

means (140) for providing a clock signal; • 

means (132) for retrieving said sampled data, from 

said memory means (1 36) in synchronism with said 
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clock signal; 

means (142) for shifting the phase of said clock 
signal to generate a phase shifted clock signal that 
is substantially aligned with said horizontal line 
synchronizing signal; and 

clock transfer means (146), responsive to said 
phase shifted clock signal, for providing said sam- 
pled data, retrieved from said memory means, in 
synchronism with said phase shifted clock signal. 

2. The apparatus set forth in Claim 1 wherein said 
main video signal includes a color reference burst 
signal component and characterized in that the 
means for providing said clock signal includes 
means for locking said clock signal in phase to said 
color reference burst signal. 

3. The apparatus set forth in Claim 1 characterized 
in that said clock phase shifting means includes: 
means, responsive to said clock signal for generat- 
ing a plurality of clock phase signals wherein each 
of said plurality of clock phase signals has a re- 
spectively different phase relationship with said 
clock signal; and 

signal phase alignment means, coupled to receive 
said horizontal line synchronizing signal, for select- 
ing one of said plurality of phase signals as said 
phase aligned clock signal, wherein said selected 
phase signal has a transition which occurs substan- 
tially concurrently with , a predetermined transition 
of said horizontal line synchronizing signal. 

4. The apparatus set forth in Claim 3 characterized 
in that said clock phase shifting means further 
includes: 

means for delaying said horizontal line synchroniz- 
ing signal by an amount of time less than one 
period of said clock signal; and 
means, responsive to said phase aligned clock 
signal and to said delayed horizontal line synchro- 
nizing signal, for generating a reference signal 
which is delayed by an amount of time substan- 
tially equal to a predetermined amount of time 
relative to the predetermined transition of said hori- 
zontal line synchronizing signal. 

5. The apparatus set forth in Claim 3 characterized 
in that said clock signal alternates between first 
and second states and said signal phase alignment 
means includes: 

means, responsive to the predetermined transition 
of said horizontal line synchronizing signal for stor- 
ing sample values representing, respectively, the 
instantaneous states of said plurality of clock phase 
signals; 

means, responsive to one of said stored sample 
values having said first state and a next subse- 
quent stored sample value having said second 
state for selecting the clock phase signal corre- 
sponding to said next subsequent sample value as 
said phase aligned clock signal. 

6. The appratus set forth in Claim 5 characterized 



in that said signal phase alignment circuitry further 
includes means for selecting a first predetermined 
one of said clock phase signals as said phase 
aligned clock signal when all of said stored sample 
s values have said first state and for selecting a 
second predetermined one of said clock phase 
signals as said phase aligned clock signal when all 
of said stored sample values have said second 
state. 

70 7. A method of aligning a periodic signal to a 
reference signal to provide an aligned periodic sig- 
nal, characterized by the steps of: 
generating, from said periodic signal, a plurality of 
phase signals having respectively different phase 

75 relationships with said periodic signal; 

storing a plurality of sample values representing, 
respectively, instantaneous values of said plurality 
of phase signals occurring coincident with a pre- 
determined transition of said reference signal; 

20 selecting one of said phase signals as sard aligned 
periodic signal in accordance with a stored sample 
values indicating a transition in a corresponding 
phase signal occurring approximately coincident 
with the predetermined transition of said reference 

25 signal; and 

selecting a predetermined one of said phase sig- 
nals as said aligned periodic signal when the 
stored sample values indicate no transition of any 
of the phase aligned signals occurring coincident 

30 with the predetermined transition of said reference 
signal. 

8. In a video signal processing system including a 
source of main video signal having a horizontal line 
synchronizing signal component and a reference 

35 burst signal component, including a source of auxil- 
iary video signal having at least a horizontal line 
synchronizing component and a luminance compo- 
nent, apparatus for synchronizing said luminance 
component with said main video signal character- 

40 ized by; 

means (140) for generating a clock signal synchro- 
nized with said reference burst signal component 
of said main video signal; 

means (124,126), responsive to said auxiliary video 
45 signal and said clock signal, for providing samples 
of said auxiliary video signal synchronous with said 
clock signal; 

means (134) including memory means (136), cou- 
ples to said means for providing samples, for writ- 
50 ing said samples of said auxiliary video signal to, 
and reading said , samples of said auxiliary video 
signal from said memory means synchronous with 
said clock signal; 

means (142), responsive to said clock signal and 
55 the horizontal synchronizing signal component of 
said main video signal, for generating a phase 
shifted clock signal having transitions in a predeter- 
mined relationship with a transition of said horizon- 
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tal synchronizing signal component; and 
transfer means (146). coupled to said memory 
means, for providing the luminance component of 
said auxiliary video signal samples read from said 
memory means synchronized with said phase shift- s 
ed clock signal. 

9. The apparatus set forth in Claim 8 wherein said 
auxiliary video signal component further includes a 
reference burst signal component and chrominance 
signal components, and said apparatus further io 
characterized by: 

means coupled to said means for providing sam- 
ples of said auxiliary video signal, for separating 
said luminance signal component and said 
chrominance signal component and for demodulat- 15 
ing said chrominance signal components; 
means for coupling said separated luminance and 
demodulated chrominance signal components to 
said means including memory means. 

10. The apparatus set forth in Claim 9 further 
characterized by means coupled to said memory 
means and said transfer means for combining 
chrominance signal components read from said 
memory means with a luminance signal component 
provided by said transfer means. 

11. The apparatus set forth in Claim 10 character- 
ized in that said means for combining chrominance 
signal components read from said memory means 
with a luminance signal provided by said transfer 
means includes means for modulating said de- 
modulated chrominance signal components syn- 
chronous with said reference burst signal compo- 
nent of said main video signal. 

12. The apparatus set forth in Claim 9 character- 
ized in that said means for separating said lu- 35 
minance signal component and said chrominance 
signal components further includes means for pro- 
viding a subsampled luminance signal component 

and subsampled demodulated chrominance signal 
components. 

13. The apparatus set forth in Ciaim 8 character- 
ized in that said means for separating a phase 
shifted clock signal includes: 

means, responsive to said clock signal for generat- 
ing a plurality of respectively delayed representa- 45 
tions of said signal; and 

signal phase alignment means, responsive to said 
horizontal synchronizing signal component of said 
main video signal, for selecting one of said plurality 
of delayed representations of said clock signal hav- 
ing a transition in a predetermined relationship with 
a transition of said horizontal synchronizing signal 
component. 

14. The apparatus set forth in Claim 8 further 
characterized by means for substituting said iu- 55 
minance component of said auxiliary video signal 
provided by said transfer means for portions of 
said main video signal. 
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